Task Taxonomy Examples

Search for the first hike in "Baby Friendly hikes" note in Apple Maps

35da47bc-36e1-42ac-9991-b074aaeb5df5

memory search
Planning Grounding Memory & App Knowledge
Navigation Depth Task Length Is Multi-App Goal Specification Determinism Action Complexity Perception Difficulty World Knowledge Memory App Knowledge
shallow medium direct deterministic ['taps', 'type'] text_only

Add Tokyo to the list of Worldclocks

b0fe266c-6ff1-41d2-8b5c-ef412c73fc41

search assistance
Planning Grounding Memory & App Knowledge
Navigation Depth Task Length Is Multi-App Goal Specification Determinism Action Complexity Perception Difficulty World Knowledge Memory App Knowledge
surface simple direct non_deterministic ['taps', 'type'] text_only

Draft an email to Carl with an attachment of wizard_of_oz_wiki file

b9adc56b-8f95-4fa5-81d0-3ac83f241c9b

search app_knowledge data_entry
Planning Grounding Memory & App Knowledge
Navigation Depth Task Length Is Multi-App Goal Specification Determinism Action Complexity Perception Difficulty World Knowledge Memory App Knowledge
shallow medium direct deterministic ['taps'] text_and_ui

Find the fastest route to nvidia headquarters avoiding highways

1b13db03-d9eb-454b-ab5e-f396eb965d9a

search assistance
Planning Grounding Memory & App Knowledge
Navigation Depth Task Length Is Multi-App Goal Specification Determinism Action Complexity Perception Difficulty World Knowledge Memory App Knowledge
deep complex direct non_deterministic ['tap', 'type'] text_and_ui

Create a new guide called 'Great Coffee Spots'

acca9e2c-f90e-4308-8769-69fbc12df2fe

data_entry assistance
Planning Grounding Memory & App Knowledge
Navigation Depth Task Length Is Multi-App Goal Specification Determinism Action Complexity Perception Difficulty World Knowledge Memory App Knowledge
surface simple direct deterministic ['taps', 'type'] text_only

Set a reminder to pick up groceries at 5 pm after work.

e9934720-0231-4c00-84c3-be707831cd75

data_entry assistance
Planning Grounding Memory & App Knowledge
Navigation Depth Task Length Is Multi-App Goal Specification Determinism Action Complexity Perception Difficulty World Knowledge Memory App Knowledge
shallow medium direct deterministic ['taps', 'type'] text_and_ui

Make the spoken directions volume in maps louder

06b08fb5-1c9b-4dd3-b597-26f7351c66fd

app_knowledge assistance
Planning Grounding Memory & App Knowledge
Navigation Depth Task Length Is Multi-App Goal Specification Determinism Action Complexity Perception Difficulty World Knowledge Memory App Knowledge
deep medium direct deterministic ['scroll', 'taps', 'type'] text_only

What is the moonrise time during next new moon day

a3197411-50cc-4fc7-a2ca-dd745a171b02

world_knowledge pure_navigation app_knowledge
Planning Grounding Memory & App Knowledge
Navigation Depth Task Length Is Multi-App Goal Specification Determinism Action Complexity Perception Difficulty World Knowledge Memory App Knowledge
shallow medium direct non_deterministic ['scroll', 'taps'] text_and_ui_and_graphics